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DETAILED ACTION 

1 . Claims 1-77 are presented for examination. 

Claim Rejections - 35 USC § 101 

2. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, macliine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 66-77 are rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter. 

Claims 66-77 are rejected under 35 U.S.C. 101 because the claims are directed to a 
signal directly or indirectly by claiming a medium and the Specification recites evidence 
where the computer readable medium is define as a "signal". In that event, the claims 
are directed to a form of energy which at present the office feels does not fall into a 
category of invention. The following link on the World Wide Web is for the United States 
Patent And Trademark Office (USPTO) policy on 35 U.S.C. §101 . 
< httD://www.uspto.qov/web/offices/pac/dapp/opla/preoqnotice/quidelines1 01 20051 026. 
Bdf> 

Claim Rejections - 35 USC §112 

3. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 
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4. Claims 1-77 are rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. 

a. The following claim languages are unclear and indefinite: 

1) Claim 1 , it is uncertain what the "functionality" is <i.e. is it the 
functionalities of hardware, software? Where does it come from? Multiple 
computers? Devices?>. 

Claims 54 and 66 have the same deficiencies as claims 1 above, 
ii) Claim 2, it is uncertain what UpnP, RMI, etc are <i.e. abbreviations 
are not allowed. > 

Claims 55 and 67 have the same deficiencies as claim 2 above. 
IN) Claim 18, it is uncertain what this claim is depended on. 



Claim Rejections - 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 
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6. Claims 1-5, 54-58, 66-70 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Ford et al.. Pub No. 2002/0107939 (hereafter Ford). 

7. As per claims 1 , 54, 66, Ford teaches a computer-based system comprising: a 
computer system executing task computing, thus enabling users to define tasks by 
combining available functionality and to execute such tasks (Abstract, Para 49). 

8. As per claims 2, 55, 67, Ford teaches wherein available functionality originates in 
devices, computing applications and electronic services available through remote 
procedure calls including Web Services, UPnP, CORBA, RMI, RPC, DCE, DCOM or 
comprises previously defined tasks (Para 40, 41 ). 

9. As per claims 3, 56, 68, Ford teaches wherein all available functionality is 
abstracted to the user as a service and each service is expressed in a service 
description language (Para 29, 37). 

1 0. As per claims 4, 57, 69, Ford teaches wherein each service has at least one 
semantic description associated with it, each semantic description can be provided by 
any combination of the creator of the service, the owner of the service or some other 
third party and the service can be made available or unavailable by making available or 
unavailable one or more of its semantic descriptions (Para 29, 30, 49). 

11. As per claims 5, 58, 70, Ford teaches means for discovering available services; 
means for filtering the services based upon relevance of the discovered services to the 
user and her context; means for specifying the task possibly in collaboration with the 
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user; means for executing tlie specified tasl<; and optionally means for creating, 
removing, and managing services (Para 49, 53). 



Claim Rejections - 35 USC § 103 

12. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

13. Claims 6-53, 59-65, 71-77 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Ford et al.. Pub No. 2002/0107939 (hereafter Ford) in view of 
Nagasaka et al., Patent No. 6,556,875 (hereafter Nagasaka). 

14. As per claims 6, 59, 71 , Ford does not specifically teach wherein the specified 
tasks are saved, automatically, or as instructed by the user, as new available services. 

However, Nagasaka teaches wherein the specified tasks are saved, 
automatically, or as instructed by the user, as new available services for the purpose of 
reusing the combined virtual devices (Column 29, lines 15-20, lines 58-66; Colum 30, 
lines 53-55; Column 26, lines 60-64). 
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It would have been obvious to one having ordinary skill in the art at the time of 
the applicant's invention to modify the teachings of Ford with wherein the specified 
tasks are saved, automatically, or as instructed by the user, as new available services, 
as taught by Nagaska, because this allows combined devices to be reused. 

15. As per claims 7, 60, 72, Nagasaka teaches wherein the previously specified 

tasks saved as services are available to the user who created them, to all other users, 
or to any user-defined, or pre-defined group of users (Colum 30, lines 53-55; Column 
26, lines 60-64). 

1 6. As per claims 8, 61 , 73, Nagasaka teaches wherein the means for discovering 
services utilize a service discovery protocol, including any one or any combination of the 
following: UPnP, UDDI, Local Service Repository, Jini, Bluetooth SDP, Rendezvous, 
and InfraRed (IR) (Column 9, lines 1-18). 

1 7. As per claims 9, 62, 74, Ford teaches wherein the means for filtering discovered 
services include any one or any combination of the following: User profile. Task at hand, 
User device characteristics. User location. User motion status. User network 
connectivity. User specified keywords, features of a set of services when considered as 
a whole, individual service features (Para 49). 

18. As per claims 1 0, 63, 75, Ford teaches wherein the means for specifying a task 
include any one or any combination of the following: a planning-based, automated 
system, or an interactive user interface that supports any one or any combination of the 
following elements: visual, voice, text. Braille, tactile (Para 40). 
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1 9. As per claims 1 1 , 64, 76, Ford teaches wherein the means for executing a 
specified task utilizes a service execution mechanism including any one or any 
combination of the following: Web Services calls, UPnP actions, CORBA, RMI, RPC, 
DCE, DCOM, InfraRed (IR), Local function call, and Local object call (Para 48). 

20. As per claims 1 2, 65, 77, Nagasaka teaches wherein the means for creating, 
removing, and managing services include any one or any combination of the following: 
Graphical user interface, service execution, device interaction, events from the 
operating system of the user-operated device and applications executing on the user- 
operated device (Column 24, lines 50-54). 

21 . As per claim 1 3, Nagasaka teaches further comprising: a module for discovering 
services; a module for filtering services; a module for automatically specifying tasks 
according to user's goals or for assisting the user In specifying tasks by providing the 
user with information about how the services comprising the tasks can be combined 
(Column 23, lines 28-34; Column 24, lines 35-50); a module for assisting the user with 
executing tasks, by invoking the services that the task is composed of and providing the 
user with means for interacting with the invoked services as they are executed, and a 
User Interface that assists the user with Service Discovery, Service Filtering, Service 
Composition, Service Execution and the saving of defined tasks for future use (Column 
24, lines 50-54). 

22. As per claim 14, Nagasaka teaches wherein the modules execute on a single 
computing device or wherein the modules, or subcomponents of the modules, are 
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distributed across multiple computing devices and are accessible by programmatic 
interfaces that are accessible to the User Interface that is preferably running on the 
device operated by the user (Column 33, lines 1-13). 

23. As per claim 15, Ford teaches wherein the user engages in Service Discovery, 
followed by Service Filtering, followed by Task Specification, followed by Task 
Execution (Para 30, 49). 

24. As per claim 16, Ford teaches wherein the user while engaged in Task 
Specification iterates one or more times through Service Discovery, or Service Filtering, 
or both (Para 49). 

25. As per claim 17, Ford teaches wherein the user while engaged in Task Execution 
iterates one or more times through Service Discovery, or Service Filtering, or Task 
Specification, or all three, or any combination of any successive two (Para 49). 

26. As per claim 1 8, Nagasaka teaches further comprising a User Interface that 
supports the workflows of Service Discovery, Service Filtering, Service Specification 
and Service Execution (Column 33, lines 20-25). 

27. As per claim 19, Nagasaka teaches wherein the User Interface is a graphical one 
and comprises any combination of: a Discovery Pane for displaying discovered services 
and filtered services; a Details Pane for displaying additional information of a selected 
service from the Discovery Pane; a Composition Pane for displaying listings of matched 
services from Discovery Pane; a Construction Pane for constructing a composition of 
services; an Information Pane for displaying general information about the processes of 
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the tool, including information about the progress of the execution; a Save Pane for 
saving a composition of services; wherein all or a subset of the panes are 
simultaneously displayable to the user and actions on each of the panes results in 
automatically updating the related information displayed in other panes (Column33, 
lines 13-40). 

28. As per claim 20, Nagasaka teaches wherein the user can move to the 
Construction pane by either selecting a service from Discovery pane and choosing the 
construct function, or by selecting a pair of matched services and choosing the 
construct function (Column 30, lines 53-67). 

29. As per claim 21 , Nagasaka teaches wherein the user can add or remove services 
from the currently composed task in the Construct pane by choosing the plus or minus 
function for each possible position that an insertion or deletion is possible, as is 
automatically determined by the back-end system (Column 27, lines 45-65). 

30. As per claim 22, Nagasaka teaches wherein the user can execute a specified 
task by choosing the execution function when that task becomes executable, as 
automatically determined by the underlying back-end system, while either at the 
Construct pane or the Composition pane (Column 27, lines 45-65). 

31 . As per claim 23, Nagasaka teaches wherein the system automatically appends 
any, pre-defined or user-defined compatible composition of available services before or 
after a partially specified composition by the user and executes the complete 
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composition whenever the user chooses the execution function (Column 27, lines 45- 
65). 

32. As per claim 24, Nagasaka teaches wherein a composition to be saved can be 
extended so that its constituent services satisfy requirements relating to their properties 
(Column 27, lines 45-65). 

33. As per claim 25, Nagasaka teaches wherein the User Interface is a graphical one 
and comprises panes including any combination of: a Discovery Pane for displaying 
discovered services and filtered services; a Details Pane for displaying additional 
information of a selected service from the Discovery Pane; a Composition Pane for 
Displaying listings of matched services from Discovery Pane; a Construction Pane for 
constructing a composition of services; an Information Pane for displaying general 
information about the processes of the tool, including information about the progress of 
the execution; a Save Pane for saving a composition of services in terms of criteria; 
wherein at any given time only one of the tabs is visible to the user and actions on each 
of the panes results in automatically updating the related information displayed in other 
panes (Column 33, lines 20-38). 

34. As per claim 26, Nagasaka teaches wherein the user can specify a task pane by 
either selecting a service from Discovery pane and choosing the construct function, or 
by selecting a pair of matched services from the Composition tab and choosing the 
construct function (Column 33, lines 20-38). 
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35. As per claim 27, Nagasaka teaches wherein the user can add or remove services 
from the currently composed task in the Construct pane by choosing the plus or minus 
function for each possible position that an insertion or deletion is possible, as is 
automatically determined by the back-end system (Column 28, lines 25-40). 

36. As per claim 28, Nagasaka teaches wherein the user can execute a specified 
task by choosing the execute function when that task becomes executable, as 
automatically determined by the underlying back-end system, while either at the 
Construct pane or the Composition pane (Column 28, lines 25-40). 

37. As per claim 29, Nagasaka teaches wherein the system automatically appends 
any, pre-defined or user-defined compatible composition of available services before or 
after a partially specified composition by the user and executes the complete 
composition whenever the user chooses the execution function (Column 28, lines 10- 
14). 

38. As per claim 30, Nagasaka teaches wherein a composition to be saved can be 
extended so that its constituent services satisfy requirements relating to their properties 
(Column 28, lines 10-14). 

39. As per claim 31 , Nagasaka teaches wherein the User Interface is a graphical one 
and comprises a first pane for displaying discovered services and filtered services and a 
second pane for displaying the current composition as composed by the user and 
controls for going back and forth in the history of the composition and a control for 
executing composition whenever possible (Column 33, lines 20-38). 
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40. As per claim 32, Nagasal<a teaclies wherein the User Interface automatically 
places a selected service to the proper place of the composition sequence (Column 28, 
lines 26-45). 

41 . As per claim 33, Nagasaka teaches wherein the User Interface will automatically 
complete the composition whenever possible, including the case when the available 
filtered services can only be combined in a single manner for a composition that can be 
executed (Column 28, lines 60-67). 

42. As per claim 34, Nagasaka teaches wherein the User Interface is a web client 
(Column 33, lines 1-12). 

43. As per claim 35, Ford in view of Nagasaka does not specifically teach wherein as 
the task is executed the user's browser might pop-up a new window or re-direct the 
browser to a new link that allows the user to enter information related to the execution of 
the task or feedback regarding the executed task. 

However, since redirection to new links is commonly practiced in the art of 
network interface for the purpose of providing friendly user experience, it would have 
been obvious to one having ordinary skill in the art at the time of the applicant's 
invention to incorporate wherein as the task is executed the user's browser might pop- 
up a new window or re-direct the browser to a new link that allows the user to enter 
information related to the execution of the task or feedback regarding the executed task 
as part of the invention in order to better user experiences. 
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44. As per claim 36, Ford teaches wherein the User Interface is a command line 
Interface, wherein each time the user types text that can be matched against discovered 
and/or filtered services, upon the user pressing a pre-assigned key, it inserts the 
matched service or, if multiple matches exist it provides a listing of them for the user to 
select by means of further typing text that matches one of the many services (Para 49). 

45. As per claim 37, Ford In view of Nagasaka does not specifically teach wherein 
the sequence of user selected service comprise a sequence that corresponds to a task 
and can subsequently be executed by means of pressing a pre-assigned key. 

However, since keeping track of what kind of service services what kind of task is 
commonly performed in the art of task management for the purpose of providing the 
correct service for a task, it would have been obvious to one having ordinary skill in the 
art at the time of the applicant's invention to modify the teachings of Ford with wherein 
the specified tasks are saved, automatically, or as instructed by the user, as new 
available services for the purpose of reusing the combined virtual devices, because it 
allows for the right services to be provided to a task. 

46. As per claim 38, Nagasaka teaches wherein the Discovery module. Filtering 
Module, Composition Module and Execution module and User Interface execute on the 
same computing device (Fig 21 , unit 100 includes everything). 

47. As per claim 39, Ford teaches wherein the Composition Module comprises an 
Inference Engine that can identify all possible pair wise combinations of services that 
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can be successfully executed in a composition given semantic descriptions of the 
constituent services (Para 40). 

48. As per claim 40, Ford teaches wherein the Composition Module comprises an 
Inference Engine that can identify all possible compositions of services that can be 
successfully executed in their entirety given the semantic descriptions of the constituent 
services (Para 30). 

49. As per claim 41 , Ford teaches wherein the number of possible pair-wise matches 
or compositions of services that are returned by the Inference engine might be restricted 
by criteria that include an upper bound on computational resources, an upper bound on 
computing time, the number of services in a composition, or by a pre-determined total 
number of pair-wise matches or compositions to be computed (Para 49, 53). 

50. As per claim 42, Ford teaches wherein the Inference Engine includes a 
composition logic wherein the composition logic is a rule, or a set of rules, or a set of 
logic statements (Par 40). 

51 . As per claim 43, Ford teaches wherein the discovery module uses local semantic 
service description (SSD) databases or accesses remote SSD databases and retrieves 
the SSDs of the found service from those databases, using the service's ID specific to 
the discovery mechanism through which the service is found (Para 29, 49). 

52. As per claims 44, 45, Ford in view of Nagasak does not specifically teach 
wherein the discovery mechanisms is UPnP and the ID is Unique Device Name (UDN) 
of UPnP. 
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However, since UPnP is commonly employed for device discovery and 
connection at the time of the applicant's invention, it would have been obvious to one 
having ordinary skill in the art to specifically use UPnP in order to connect devices with 
one another. 

53. As per claim 46, Nagasaka teaches wherein the User Interface is running on a 
computing device that is different than the computing devices Discovery Module, 
Filtering Module, Composition Module and Execution module execute (Column 33, lines 
1-15). 

54. As per claim 47, Nagasaka teaches wherein the User Interface is a web client 
(browser) that communicates with the Discovery, Filtering, Composition and Execution 
Modules using http (Column 33, lines 1-15). 

55. As per claim 48, Nagasaka teaches wherein the User Interface is an application 
that executes on the end-user's computing device and communicates with each of the 
Discovery, Filtering, Composition and Execution modules via the programmatic 
interface of these modules (Column 33, lines 1-15). 

56. As per claim 49, Ford teaches wherein the end-user is using any of a desktop, 
laptop, pen computer, PDA or mobile phone (Para 39). 

57. As per claim 50, Nagasaka teaches wherein a service may have one or more 
interfaces for the user to interact with the service prior and during its execution (Column 
32, lines 20-30). 
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58. As per claim 51 , Ford in view of Nagasaka does not specifically teach wherein a 
service comprises any one of: "View on Display" which lets the user to view a user- 
specified document on a display and optionally control how it is shown; "View on 
Multiple Displays" which lets the user to view a user-specified document on more than 
one display and optionally control how it is shown; "Map Viewer" which lets the user to 
view a map of a user-specified location and optionally control how it is shown; "Map 
Router" which lets the user to view a map or textual description of the route from/to a 
user-specified location from/to a predefined or a user-specified location optionally 
control how it is shown; "Instance Providing Service" which provides, when executed, a 
semantic instance where a semantic instance is an instance of a class described in an 
ontology; "Print" which lets the user to print a user-specified document or an semantic 
instance in a specific format on a printer in a pre-defined way or optionally control how it 
is printed; "Fax" which lets the user to send a fax of a user-specified document to a 
user-specified fax number and optionally control how it is faxed; "Play Video" which lets 
the user to play a user-specified video content and optionally control how it is played; 
"Play Audio" which lets the user to play the user-specified audio content and optionally 
control how it is played; "Digital Photo Frame" which lets the user to show a user- 
specified image content and optionally control how it is shown; "Location Determination" 
which automatically determines the location of a user-operated device; "Directory 
Publisher" which lets the user to choose one instance out of set of instances of the 
same type; "Telephone Dialer" which lets the user to dial a user-specified phone 
number; "TC Storage" which lets the user to store or retrieve files; "Copy to Removable 
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Storage" which lets the user to store one or a set of files into predefined removable 
storage media and optionally control how they are saved; "Emailer" which lets the user 
to send email to a user-specified email address optionally with attached user-specified 
documents and optionally control how it is sent; "List chooser" which lets the user to 
choose an semantic instance from the list of semantic instances of the same type; 
"Property chooser" which lets the user to choose one of the properties from a semantic 
instance; "Your input" which lets the user to input the values for the attributes of the 
semantic object; "Instance viewer" which lets the user to check and modify a semantic 
instance; "Local Instance Selector" which lets the user to select one or more semantic 
instances local to the computing device; "Semantic Instance Copier" which lets the user 
to copy the semantic instance into the local computing device; "L-Note" which lets the 
user to read and leave notes pertinent to a location; "Database publisher" which 
publishes a whole of or a part of a table from a database; "Place information" which 
provides information related to the place; and "Hosted Services" which uses the client- 
side browser functionalities to accomplish their tasks, including "Upload File" to let the 
user to upload a file from the client device, "URL to input" to let the user to input an 
URL, and "View on Browser" to let the user view the file on the client device. 

However, since all these viewing and user interaction techniques above are 

commonly practiced in the art of user interface at the time of the applicant's invention for 
the purpose of bettering user experience, it would have been obvious to one having 
ordinary skill in the art at the time of the applicant's invention to modify the teachings of 



Application/Control Number: 10/733,328 Page 18 

Art Unit: 2195 

Ford in view of Nagasal<a witli tlie specifics of tecliniques above in order to better user 
experiences. 

59. As per claim 52, Ford teaclies wlierein tlie means for creating, removing, and 
managing services includes any one or combination of the following: means for making 
SDSs available through one or more of the discovery mechanisms, means for changing 
the discovery mechanism to use, means for holding the SDS, means for recovering the 
SDS to one of the discovery mechanisms, means for removing the SDSs from discovery 
mechanisms, and means for changing its publishing parameters including expiration, 
invocation limit, and access control (Para 53). 

60. As per claim 53, Ford in view of Nagasaka does not specifically teach wherein 
the means for creating, removing, and managing services comprise any one or a 
combination of: "PIPE" which provides local or remote APIs to publish and optionally 
manage services, and optionally provides the user with user interfaces to publish and 
manage the services; "Semantic Instance Scrapers for Applications" which publishes 
the instances as they become available for the application and optionally lets the user 
manage the service provisions; "Instance Selector with Instance Providing Service 
Creation" which lets the user publish the instance the user selected for the instance 
selector service and optionally lets the user manage the service provisions; "White hole" 
which lets the user publish objects from a local computing device as semantic instances 
through its user interface and optionally lets the user manage the service provisions; 
"Public Directory" which lets the user publish instances on a device and optionally lets 
the user manage the service provisions; "Bank" which lets the user publish instances 
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through its service invocation and optionally lets the user manage the service 
provisions; "Image/AudioNideo Service Control" which lets the user publish instances 
created by or from the devices and optionally lets the user manage the service 
provisions; "Removable Media Publisher" which lets the user publish instances on the 
removable media inserted into a computing device and optionally lets the user manage 
the service provisions; and "Fax" which publishes the documents received and 
optionally lets the user manage the service provisions. 

However, since all these user interaction techniques above are commonly 
practiced in the art of user interface at the time of the applicant's invention for the 
purpose of bettering user experience, it would have been obvious to one having 
ordinary skill in the art at the time of the applicant's invention to modify the teachings of 
Ford in view of Nagasaka with the specifics of techniques above in order to better user 
experiences. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to MENGYAO ZHE whose telephone number is (571 )272- 
6946. The examiner can normally be reached on Monday Through Friday, 7:30 - 5:00 
EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Meng-Ai An can be reached on 571-272-3756. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Li B. Zhen/ 

Primary Examiner, Art Unit 2194 



